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Abstract 

We introduce a new rounding technique designed for online optimization problems, which is related 
to contention resolution schemes, a technique initially introduced in the context of submodular function 
maximization. Our rounding technique, which we call online contention resolution schemes (OCRSs), 
is applicable to many online selection problems, including Bayesian online selection, oblivious posted 
pricing mechanisms, and stochastic probing models. It allows for handling a wide set of constraints, 
and shares many strong properties of offline contention resolution schemes. In particular, OCRSs for 
different constraint families can be combined to obtain an OCRS for their intersection. Moreover, we 
can approximately maximize submodular functions in the online settings we consider. 

We, thus, get a broadly applicable framework for several online selection problems, which improves 
on previous approaches in terms of the types of constraints that can be handled, the objective functions 
that can be dealt with, and the assumptions on the strength of the adversary. Furthermore, we resolve 
two open problems from the literature; namely, we present the first constant-factor constrained oblivious 
posted price mechanism for matroid constraints, and the first constant-factor algorithm for weighted 
stochastic probing with deadlines. 
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1 Introduction 


Recently, interest has surged in Bayesian and stochastic online optimization problems. These are problems 
where we can use limited a priori information to select elements arriving online, often subject to classical 
combinatorial constraints such as matroids, matchings and knapsack constraints. Examples include posted 
pricing mechanisms (3[24, TSI], prophet inequalities lfl8l . probing models fTT! Q]], stochastic matchings Q, 
and secretary problems fl2l l20l[l5Tl n Simultaneous with this development, interest has arose also in gener¬ 
alizing the optimization of linear objective functions to relevant nonlinear objective functions. A particular 
focus was set on submodular functions, which is a function class that captures the property of diminishing 
returns, a very natural property in many of the above-mentioned settings lf2Tl [T, 411T61. 

A very successful approach for these problems is based on first using the a priori information to formu¬ 
late an (often linear) relaxation whose optimal fractional solution x* upper bounds the performance of any 
online (or even offline) algorithm. Then, x* is used to devise an online algorithm whose goal is to recover 
a solution of a similar objective value as x*. Such an online algorithm can also be interpreted as an online 
rounding procedure for rounding x*. In particular, online rounding approaches have recently been used to 
obtain nearly optimal and surprisingly elegant results for stochastic matchings (see Bansal et al. |[3jl), and for 
a very general probing model introduced by Gupta and Nagarajan lilTl with applications in posted pricing 
mechanisms, online matching problems and beyond. 

A key ingredient in the general rounding algorithms presented in jl7l are so-called contention resolution 
schemes (CRSs), a rounding technique introduced by Chekuri et al. flOl in the context of (offline) submodu¬ 
lar function maximization. CRSs are defined with respect to a constraint family, like matroids, matching, or 
knapsack constraints. Interestingly, the existence of a so-called ordered CRS for the given constraint family 
is all that is needed to apply the techniques of lH71 . Whereas this generality is very appealing, there are some 
inherent barriers in current CRSs that hinder a broader applicability to online settings beyond the probing 
model defined in ifTTl . More precisely, most settings considered in ifTTIl require that the algorithm can choose 
the order in which to obtain new online information about an underlying ground set over which the objective 
is optimized. This is due to the fact that most CRSs need to round the components of a fractional point x* 
step by step in a particular order. 

In this paper we introduce a stronger notion of contention resolution schemes that overcomes this restric¬ 
tion and allows for the online information to be presented adversarially. We show that such schemes exist 
for many interesting constraint families, including matroid constraints and knapsack constraints. As we dis¬ 
cuss in Section [L3l this leads to a broadly applicable online rounding framework that works in considerably 
more general settings than previous approaches. Furthermore, our techniques answer two open problems 
from the literature: we show the existence of a constrained oblivious posted-pricing mechanism (COPM) 
for matroids, intersection of matroids, and further constraints families (a question first raised in 00); and 
we get an 0(1 [-competitive algorithm for the weighted probing problem with deadlines introduced in IfTTl . 
Additionally, our rounding approach yields optimal guarantees (up to moderate constant factors) for a class 
of online submodular function maximization problems. 

Before we formally define our rounding framework (Section 11.11) . state our results (Section 11.21) and 
describe the aforementioned applications (Section 11.31) . it is helpful to introduce our rounding framework 
in the light of a concrete example. Consider the following Bayesian online selection problem studied by 
Kleinberg and Weinberg lfl8l in the context of prophet inequalities. There is a finite set N of items or 
elements, and a nonnegative random variable Z e for each e £ N, where all [Z, are independent. The 
distributions of all Z e are known and for simplicity we assume they are continuous. Furthermore, a matroid 

1 Strictly speaking, secretary problems have no a priori information. However, as items arrive in a random order, most algorithms 
first observe a fraction of the elements (serving as the a priori information), and then devise an online strategy based on this 
information. 
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M = (N, F) on N is given@ Let {z e },-, G; v be realizations of the random variables {Z e } eS jv- The goal is to 
select a subset I C N of the elements that is independent, i.e., / £ J, and whose value z(I) := YleeE z e 
is as large as possible. The way how elements can be selected works as follows. Elements e £ N reveal 
one by one their realization z e , in a fixed prespecified order that is unknown to the algorithm. Whenever a 
value z e is revealed, one has to choose whether to select e or discard it, before the next element reveals its 
realization. 

A natural way to approach this problem is to define a threshold t e > 0 for each e € N and only accept 
elements e € N whose realization is at least the threshold, i.e., z e >t e \ we call such elements active. Let 
x e be the probability of e being active, i.e., x e = Pr[Z e > t e ]. Notice that the set of all active elements 
is distributed like a random set that contains each element e independently with probability x e . We denote 
such a set by R(x). As we show in Section IU using a convex relaxation one can find thresholds t e such that: 
(i) x = (.i' e ) eG; .y is in the matroid polytope -P^H and (ii) an algorithm that disregards the matroid constraint 
and accepts any active element would have an expected return at least as good as the one of an optimal 
offline algorithm. 

Our goal is to design an online algorithm that only selects active elements, such that an independent set 
I is obtained where Pr[e £ I] > c ■ x e for all e £ E, where c £ (0,1] is a constant as large as possible. 
It is not hard to check that such a procedure would lead to an objective value of at least c times the offline 
optimum. The guarantee we are seeking closely resembles the notion of c-balanced CRSs as defined in ifTOl . 
which is an offline algorithm that depends on x and returns for any set S C. N a (potentially random) subset 
7 t(S) C S with 7 t(S) £ F such that Pr[e £ 7r(i?(x))] > c • x e . The only reason why this procedure is 
not applicable in the above context is that, in general, ir needs to know the realization of the full set R(x) 
in advance to determine ir(R(x)). However, R(x) is revealed element by element in the above selection 
problem. A key observation in liTTl is that some CRSs do not need to know the full set R(x) upfront, but 
can round step by step if the elements come in some prescribed order chosen by the algorithm. However, in 
the above setting, as in many other combinatorial online problems, the order cannot be chosen freely. 

We overcome this limitation through a considerably stronger notion of CRSs, which we call online 
contention resolution schemes (OCRSs). 

1.1 Online contention resolution schemes 

OCRSs, like classical contention resolution schemes, are defined with respect to a relaxation of the feasible 
sets of a combinatorial optimization problem. Consider a finite ground set N = {e i,. .., e n }, and a family 
of feasible subsets F C 2 N , which is down-closed, i.e., if I € F and J C I then J £j. Let FR C [0,1 ] N 
be the polytope corresponding to the feasible sets F, i.e., FR is the convex hull of all characteristic vectors 
of feasible sets: 

Pj = conv({li? | / £ J 7 }) . 

We highlight that throughout this paper we focus on down-closed feasibility constraints. 

Definition 1.1 (relaxation). We say that a polytope P C [0, 1 ] v is a relaxation of Pj if it contains the same 
{0, 1}-points, i.e., P n {0,1}^ = Pj Cl {0,1}^. 

We start by defining online contention resolution schemes (OCRS) simply as algorithms that can be 
applied to the online selection problem highlighted in the introduction. The performance of an OCRS is 
then characterized by additional properties that we define later. 

2 We recall that a matroid M = ( N, tF) consists of a finite ground set N and a nonempty family T C 2^ of subsets of N 
satisfying: (i) If I € T,J C I, then J E T, and (ii) if I, J £ T, \ J\ > |/|, then Be £ J \ I with J U {e} £ T. If not stated 
otherwise, we assume that matroids are given by an independence oracle that, for every / C N, returns whether I £ T. 

’The matroid polytope Pf is the convex hull of all characteristic vectors of independent sets. In particular it can be described 
by Pjr = {x £ R> 0 | x(S) < rank(Sj VS 1 C N}, where rank(5j = max{|/| | I C S, I £ J-} is the rank function of M. 
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Definition 1.2 (Online contention resolutions scheme (OCRS)). Let us consider the following online selec¬ 
tion setting. A point x G P is given and let R(x) be a random subset of active elements. The elements 
e € N reveal one by one whether they are active, i.e., e G R(x), and the decision whether to select an active 
element is taken irrevocably before the next element is revealed. An OCRS for P is an online algorithm that 
selects a subset I C R(x) such that 1/ G P. 

Most of the OCRSs that we present follow a common algorithmic theme, which leads us to the definition 
of greedy OCRS. 

Definition 1.3 (Greedy OCRS). Let P C [0, 1 ] v be a relaxation for the feasible sets T C I N . A greedy 
OCRS 7 t for P is an OCRS that for any x G P defines a down-closed subfamily of feasible sets P x , x Q d~, 
and an element e is selected when it arrives if together with the already selected elements, the obtained set 
is in T^, x - 

If the choice of x given x is randomized, we talk about a randomized greedy OCRS; otherwise, we 
talk about a deterministic greedy OCRS. We also simplify notation and abbreviate J~ T ^ X by T x when the 
OCRS 7T is clear from the context. 

For simplicity of presentation, and because all our main results are based on greedy OCRSs, we restrict 
our attention to this class of OCRSs, and focus on greedy OCRSs when defining and analyzing properties. 

As mentioned in the example shown in the introduction, a desirable property of OCRSs would be that 
every element e G N gets selected with probability at least c • x e for a constant c > 0 as large as possible. 
This property is called c-balancedness in the context of classical contention resolution schemes. Flowever, 
to be precise about such properties in the online context that we consider, one has to specify the power of the 
adversary who chooses the order of the elements. Adversaries of different strengths have been considered in 
various online settings. For example, one arguably weak type of adversary is an offline adversary, who has 
to choose the order of the elements upfront, before any elements get revealed. On the other end, the most 
powerful adversary that can be considered is what we call the almighty adversary, an almighty adversary 
knows upfront the outcomes of all random events, which includes the realization of R(x) and the outcome 
of the random bits that the algorithm may query. An almighty adversary can thus calculate exactly how 
the algorithm will behave and reveal the elements in a worst case order. A typical adversary type that is 
in between these two extremes is an online adversary, who can choose the next element to reveal online 
depending on what happened so far; thus, it has the same information as the online algorithm. Throughout 
this paper, when not indicated otherwise, we assume to play against the almighty adversary. 

In the context of greedy OCRSs, we define a considerably stronger notion than c-balancedness, which 
we call c-selectability, and which leads to results even against the almighty adversary. In words, a greedy 
OCRS is c-selectable if with probability at least c, the random set R(x) is such that an element e is selected 
no matter what other elements I of R(x) have been selected so far as long as I G T x . Thus, it guarantees 
that an element is selected with probability at least c against any (even the almighty) adversary. 

Definition 1.4 (c-selectability). Let c G [0, 1]. A greedy OCRS for P is c-selectable if for any x G I J we 
have 

Pr[J U {e} G T x MIC R{x),I G P x \ > c Me G N . 

We highlight that the probability in Definition 1 1.41 is over the random outcomes of R(x) when dealing 
with a deterministic greedy OCRS; when the greedy OCRS is randomized, then the probability is over R(x) 
and the random choice of T x . We call an element eGJV selectable for a particular realization of R(x) and 
random choice of T x if I U {e} G T x for all I C R(x) with I G T x . 

As aforementioned, the c-selectability is a very strong property that implies guarantees against any 
adversary. Despite this strong definition, we show that Oflj-sclcctablc greedy OCRSs exist for many natural 
constraints. 
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Often, a larger factor c can be achieved when x is supposed to be in a down-scaled version of P. This is 
similar to the situation in classical contention resolution schemes. 

Definition 1.5 ((6, c)-selectability). Let b,c £ [0,1], A greedy OCRS for P is ( b,c)-selectcible if for any 
x £ b ■ P we have 

Pr [I U {e} £ T x VIC R(x),I £ P x ] > c Ve <E N . 

Notice that a (b, c)-selectable greedy OCRS implies a randomized 6c-selectable greedy OCRS because 
we can “scale down” x online by only considering each element e with probability b independent of the 
other elements. 

Observation 1.6. A (b , c)-selectable greedy OCRS for P implies a (randomized) bc-selectable greedy OCRS 
for P. 

The existence of OCRSs is interesting even regardless of efficiency issues. Still, in many applications it 
is important to have efficient OCRSs. 

Definition 1.7 (efficiency). A greedy OCRS vr is efficient if there exists a polynomial time algorithm that, for 
a given input x, samples an efficient independence oracle for the set Jv. x . That is, an oracle that answers 
in polynomial time queries of the form: is a set S C N in x ? 

We next summarize our technical results before highlighting the implications of our results to various 
online settings. 

1.2 Our results 

Our first technical result proves the existence of greedy OCRSs with constant selectability for relaxations 
of several interesting families of constraints. All the greedy OCRSs described by Theorem 11.81 are either 
efficient, or can be made efficient at the cost of an arbitrarily small constant e > 0 loss in the selectability 
guarantee. 

Theorem 1.8. There exist: 

• For every b £ [0,1], a {b, 1 — b)-selectable deterministic greedy OCRS for matroid polytopes. 

• For every b £ [0,1], a (b, e~ 2b )-selectable randomized greedy OCRS for matching polytopes^ 

• For every b £ [0, t/2], a (b. ) -selectable randomized greedy OCRS for the natural relaxation of a 

knapsack constraint. 

Interestingly, it turns out that there is no (6, c)-selectable deterministic greedy OCRS for the natural re¬ 
laxation of a knapsack constraint for any constants b and c. This stands in contrast to the case of the matching 
poly tope, for which the randomized greedy OCRS given by Theorem 1 1.8 1 can be made deterministic at the 
cost of only a small loss in the selectability. 

Like offline CRSs, greedy OCRSs can be combined to form greedy OCRSs for more involved con¬ 
straints. 

Theorem 1.9. If 7T 1 is a (b, C] )-selectable greedy OCRS for a polytope P\, and tt 2 is a (b, cf-selectable 
greedy OCRS for a polytope Pi, then there exists a ( b, c\ ■ cf)-selectable greedy OCRS for the polytope 
Pi 0 Po- Moreover, the last greedy OCRS is efficient if it 1 and t r 2 are. 

4 Our greedy OCRS works also for a weaker relaxation of matching which only bounds the degree of each node. 
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Notice that Theorem II .91 can be applied repeatedly to combine several OCRSs. Thus, Theorems 11.81 
and ll.9l prove together the existence of constant selectability greedy OCRSs for any constant intersection of 
matroid, matching and knapsack constraints. 

It is easy to see that, given a non-negative increasing linear objective function, a (6, c)-selectable greedy 
OCRS for a polytope P can be used to round online a vector x € bP while losing only a factor of c in the 
objective. Theorem 11.101 proves this result formally, and extends it to nonnegative submodulaJl functions. 
To state this theorem, we need to define some notation. Given a function /: 2 N —> M, the multilinear 
extension of / is a function F : [0,1]^ —> M whose value for a vector x £ [0,1]^ is F(x) = E[/(i?(a;))]. 
Informally, F(x) is the expected value of / over a set obtained by randomly rounding every coordinate of x 
independently. 

Theorem 1.10. Given a nonnegative monoton^submodular function f: 2 N — > M>o and a (b , c) -selectable 
greedy OCRS for a poly tope P, applying the greedy OCRS to an input x £ hP results in a random set S 
satisfying E[/(,S')] > c-F(x), where F is the multilinear extension off. Moreover, even if f is not monotone, 
E[/(f ?( 1 /2 • Is))] > (c/4) • F(x), where the random decisions used to calculate i?(V 2 ■ Is) are considered 
part of the algorithm, and thus, known to the almighty adversary. 

In many applications the use of Theorem 1 1.1 01 requires finding offline, using the available a priori infor¬ 
mation, a vector x (approximately) maximizing the multilinear extension F. This can often be done using 
known algorithms. For example, Calinescu et al. (71 proved that given a non-negative monotone submodular 
function f : 2 N — >• M>o and a solvable!/] polytope P C [0, 1] ;V , one can efficiently find a fractional point 
x £ P for which F(x) > (1 — e _1 ) • max{/(S) | Is £ P}. Chekuri et al. (TOl showed that even when 
/ is not monotone, an analogous result can be obtained with a worse constant factor of 0.325 instead of 
1 — e _1 when P is solvable and down-closed. A simpler procedure with a stronger constant factor was later 
presented by Feldman et al. lfl4il . implying that one can efficiently find a fractional point x £ P for which 
F(x) > (e -1 — o(l)) • max{/(5) | Is £ P} as long as the polytope P is solvable and down-closed. 

The result of Theorem l 1. lOl for a non-monotone submodular objective can sometimes be improved when 
assuming an online adversary (instead of an almighty one). The class of OCRSs for which this can be done 
is a bit involved to define, and we defer its definition to Section [3] We state here only the following special 
case of the result we prove. 

Theorem 1.11. Let it be a ( b,c)-selectable greedy OCRS ir for a polytope P that was obtained by using 
Theorem U ,9\ to combine the OCRS ofTheorem \1.8\ Then, for every given non-negative submodular function 
f: 2 n —> M>o there exists an OCRS i r' for P that for every input vector x £ bP and online adversary 
selects a random set S such that E[/(S'))] > c • F(x). 

The OCRS it' guaranteed by Theorem 11.111 is not efficient. However, if n is efficient then it' can be 
made efficient at the cost of an additive loss of |iV|~ d • max{/({e}) | x e > 0} in the guarantee (where d is 
any positive constant). 

1.3 Applications 

In this section we present a few applications for our technical results. All these applications were previously 
studied in the literature, and connections have been found between them. In this work we show that all three 
applications can be reduced to finding appropriate OCRSs. In addition to proving new results, we believe 
that these reductions into one common setting clarify the connections between the three applications. 

5 A set function /: 2^ —> R is submodular if f(A) + f{B) > f(A UB) + f(A (~l B ) for every two sets A, B C TV. 

6 A set function /: 2 N —r R is monotone if f(A) < f(B) for every two sets A C B C N. 

7 A polytope is solvable if one can optimize linear functions over it. 
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Prophet inequalities for Bayesian online selection problems 

Consider again the Bayesian online selection problem we sketched earlier in the introduction. We recall 
that the setting in this problem consists of a matroid M = (N, F) and independent non-negative ran¬ 
dom variables Z e for every e G N with known distributions. Moreover, the random variables Z e satisfy 
maxegjv E[Z e ] < oo. An offline adversary chooses upfront the order in which the elements e € N reveal 
a realization of Z e . The task is to select online an independent set of elements / £ J with total weight 
z(I) = z e as high as possible. 

A fundamental result about the relative power of offline and online algorithms in a Bayesian setting 
was obtained by Krengel, Sucheston and Garling (see lfl9l l for the special case when M is the uniform 
matroid of rank one, i.e., precisely one element can be selected. They showed that there exists a selection 
algorithm returning a single element of expected weight as least |E[max eG jv Z e ], i.e., half of the weight of 
the best offline solution, which is the best solution obtainable by an algorithm that knows all realizations 
upfront. Recently, Kleinberg and Weinberg fll8l extended this result considerably by showing that the same 
guarantee can be obtained when selecting multiple elements that have to be independent in the matroid M, 
i.e., there exists an online algorithm returning a set I C F satisfying 
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Inequalities of type ([III are often called prophet inequalities due to the interpretation of the offline adversary 
as a prophet. Moreover, Kleinberg and Weinberg generalized their result to the setting where F are the 
common independent sets in the intersection of p matroids. For this setting, they present an online algorithm 
whose expected profit is at least jJ—, times the expected maximum weight of a feasible set. Kleinberg and 
Weinberg’s algorithms work not just against an offline adversary, which is the adversary type typically 
assumed in Bayesian online selection, but also against an online adversary. 

Using a simple, yet very general link between greedy OCRSs and prophet inequalities we can generate 
prophet inequalities from greedy OCRSs. 

Theorem 1.12. Let F C 2 N be a down-closed set family and P be a relaxation of F. If there exists a 
c-selectable greedy OCRS for P then there is an online algorithm for the Bayesian online selection problem 
with almighty adversary that returns a set I € F satisfying 
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As we discuss in Section [4] the above theorem can be made constructive in many cases, assuming that 
the OCRS is efficient and some natural optimization problems involving the distributions of the random 
weights Z e can be solved efficiently. 

Our results show that constant-factor prophet inequalities are often possible even against an almighty 
adversary. Moreover, we get 0(l)-factor prophet inequalities for a wide set of new constraint families. 

Corollary 1.13. There are 0(1 )-factor prophet inequalities for the Bayesian online selection problem 
against the almighty adversary for any constraint family that is an intersection of a constant number of 
matroid, knapsack, and matching constraints. 

In contrast, so far, the most general prophet inequality was the -factor prophet inequality of Klein¬ 
berg and Weinberg for the intersection of p matroids. Interestingly, even for this specific setting of the 
intersection of p matroids, considered by Kleinberg and Weinberg, our general approach allows for obtain¬ 
ing a better constant for p > 4 (against a stronger adversary). 


6 














Corollary 1.14. There is an ^ , -factor prophet inequality for the Bayesian online selection problem 
against the almighty adversary when the feasible sets are described by the intersection ofp matroids. 

That our results hold against an almighty adversary is in particular of importance for applications of 
prophet inequalities to posted pricing mechanisms. Indeed, one of the main technical difficulties that Klein- 
berg and Weinberg fl8l had to overcome to apply their results to posted pricing mechanism, was the fact 
that their results were only with respect to an online adversary. 

Oblivious posted pricing mechanisms 

We start by introducing the Bayesian single-parameter mechanism design setting (short BSMD), largely 
following HO. There is a single seller providing a set N of services, and for each service e £ N there 
is one agent interested in e, whose valuation is drawn from a nonnegative random variable Z e . The Z e are 
independent and have known distributions. Furthermore, there is a down-closed family F C 2 n representing 
feasibility constraints faced by the seller, i.e., the seller can provide any set of services S € F. The setting 
is called single-parameter because every agent is interested in precisely one service. The goal in this setting 
is to find truthful mechanisms maximizing the expected revenue. 

From a theoretical point of view, this setting is well understood and optimally solved by Myersons’s 
mechanism lf22l . Unfortunately, the resulting mechanism is impractical, and thus, rarely employed. Fur¬ 
thermore, it does not extend to multi-parameter settings where an agent may, for example, be interested in 
buying one out of several items, a setting known as Bayesian multi-parameter unit-demand mechanism de¬ 
sign (BMUMD). Therefore, Chawla et al. IS] suggested considerably simpler and more robust alternatives 
having many advantages while maintaining an almost optimal performance HJlMlIISl- The idea is to offer 
to the agents sequentially take-it-or-leave-it prices as follows. Agents are considered one by one, in an order 
chosen by the algorithm. Whenever an agent e € N is considered, the algorithm either makes no offer to 
e —and thus e does not get served—or, if e can be added to the elements selected so far without violating 
feasibility, an offer p e £ M>o is made to e. Agent e will then accept the offer if Z e > p e and decline if 
Z e < Pe- 

This type of mechanism, with the additional freedom that the algorithm can choose the order in which 
to consider the agents, is called a sequential posted price mechanism. A natural stronger version of sequen¬ 
tial posted price mechanisms, called constrained oblivious posted price mechanisms (COPM), suggested by 
Chawla et al. |8], allows for dealing with the multi-parameter setting BMUMD, and has many further inter¬ 
esting properties. Formally, a COPM is defined by a tuple (p £ M> 0 , F r ), where p are the take-it-or-leave-it 
prices, and F' C F. A COPM defined by (p. F') works as follows. Consider the moment when a new agent 
e arrives and let S be the set of agents served so far. If S U {e} f F', then e is skipped; otherwise, e is of¬ 
fered the price p e . In short the COPM maintains a feasible set in the more restricted family F', and greedily 
selects any agent e that does not destroy feasibility in F' and has a valuation of at least p e . Furthermore, the 
order of the agents is chosen by an adversary at the beginning of the procedure, knowing all valuations z e , 
the prices p e and the family F'. A COPM can also be randomized, in which case the tuple (p, F') is chosen 
at random at the beginning of the algorithm. 

So far, COPMs with an 0(1) gap with respect to the optimal mechanism were only known for very 
restricted types of matroids, and the intersection of two partition matroids ®. For general matroids, the best 
previously known COPM was a non-efficient procedure with an optimality gap of O (log(rank)), where 
rank is the size of a largest feasible set of the matroid (§]. In particular, the existence of an COPM for 
general matroids with constant optimality gap remained an open problem. 

Exploiting a link between greedy OCRSs and COPMs, we resolve the open question about 0(l)-optimal 
COPMs for matroids raised in |[8]], and show that even much more general constraint families admit 0(1)- 
optimal COPMs. 
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Theorem 1.15. Let P C 2 ;V be a down-closed family and P be a relaxation of P. If there is a c-selectable 
greedy OCRS for P, then there is a COPM for T that, even against an almighty adversary, is at most a 
factor of c worse than the optimal truthful mechanism. 

Using the reduction from the multi-parameter setting to the single-parameter setting presented in @ we 
obtain results for BMUMD under very general feasibility constraints. 

Corollary 1.16. Let P be the intersection of a constant number of matroid, knapsack, and matching con¬ 
straints. Then there is a posted price mechanism for BMUMD on P whose optimality gap with respect to 
the optimal truthful mechanism is at most a constant. 

Moreover, as we highlight in Section [4j the mechanisms obtained through our greedy OCRSs can be 
implemented efficiently under mild assumptions. 

Stochastic probing 

Recently, Gupta and Nagarajan lU71 introduced the following stochastic probing model. Given is a finite 
ground set N and each element e £ N is active with a given probability p e £ [0,1], independently of 
the other elements. Furthermore, there is a weight function w : N —>• Z, and two down-closed constraint 
families P in , P out C 2 v on N, which are called the inner and outer constraints, respectively. The goal is to 
select a subset of active elements of high weight according to the following rules. An algorithm must first 
probe an element e £ IV to select it. If a probed element e is active, then e is selected, otherwise it is not. 
The algorithm can choose the order in which elements are probed. The set Q of all probed elements must 
satisfy Q £ P out and the set S C Q of all selected elements must satisfy S £ P in . Hence, at any step of the 
algorithm an element can only be probed if adding it to the currently probed elements does not violate P ou u 
and adding it to the elements selected so far does not violate P in . Gupta and Nagarajan ifTTl showed that this 
model captures numerous applications. Furthermore, they show how so-called ordered CRSs can be used to 
get approximately optimal approximation factors for many constraint families including the intersection of a 
constant number of matroids. However, due to their use of ordered CRSs, the presented algorithms crucially 
rely on the fact that the order in which elements are probed can be chosen freely. 

Replacing their use of ordered CRSs with OCRSs we can drop this requirement. 

Theorem 1.17. Let Pin, Pout, f 2 V be two down-closed families. If there are a (6, Cin)-selectable greedy 
OCRS -Kin for a relaxation Pi n of Pi n and a (b,c ou t)-selectable greedy OCRS 7T ou i for a relaxation P out 
of Pout, then there is a (b ■ Ci n ■ c ou t)-approximation for the weighted stochastic probing problem where 
the order in which elements can be probed is chosen by an almighty adversary and the inner and outer 
constraints are given by P ln and Pout, respectively^ Moreover, if x ln and n ou t are efficient and there are 
separation oracles for Pi n and P ou t, then the above algorithm has a polynomial time complexity. 

It turns out that the extension to arbitrary probing orders resolves an open question of lfl7ll about stochas¬ 
tic probing with deadline. In a probing problem with deadlines there is a deadline d e £ Z>i for each element 
e £ N, indicating that e can only be probed as one of the first d e elements that get probed. Using a clever 
technique, Gupta and Nagarajan ifTTll presented an 0(l)-approximation for this problem setting for the un¬ 
weighted case, i.e ., w is the all-ones vector, when Pin, Pout are /c-system^, for k = 0(1). They left it as 
an open question how to approach the weighted version of stochastic probing with deadlines. Using OCRSs 

8 Similar to G3 one can strengthen the theorem, and only assume an offline CRS for Pout and an OCRS for Tin. The fact that 
an offline CRS suffices for Tout can sometimes be used to get better approximation factors. For simplicity of presentation, we do 
not go into these details here, and also in Theorem ll.18l and ll.19l 

9 A fc-system T C 2 N is a down-closed family such that, for any S C IV, the ratio of the sizes of any two maximal sets of T 
that are contained in S is at most k. In particular, fc-systems generalize the intersection of k matroids. 







we can leverage Theorem ll.l7l to consider elements in increasing order of their deadlines, which allows for 
addressing this open question. 

Theorem 1.18. Let P rn . T nv i C 2 v be two down-closed families. If there are a (b, Ci n )-selectable greedy 
OCRS ttinfor a relaxation Pi n of P m and a (b. c ou t)-selectable greedy OCRS tt ov j, for a relaxation P out of 
Tout, then there is a (6(1 — 6) • c ln ■ c ou t)-approximation for the weighted stochastic probing with deadlines 
problem where the inner and outer constraints are given by P rn and T ou t, respectively. Moreover, if tt ui 
and Ttout are efficient and there are separation oracles for P, n and P ou t, then the above algorithm has a 
polynomial time complexity. 

We highlight that the stochastic probing problem with monotone submodular objectives but without 
deadlines—in short, submodular stochastic probing —was considered by Adamczyk et al. 031, who presented 
for this setting a (1 — l/e)/(fcj n + k ou t + 1)-approximation when P vn and F out are the intersection of ki n 
and k ou t matroids, respectively. Using our techniques we obtain 0( ^-approximations for considerably 
more general settings of submodular stochastic probing. More precisely, we can handle a very broad set 
of constraints, with a probing order chosen by an almighty adversary (instead of being choosable by the 
algorithm). 

Theorem 1.19. Let P rn , T ou t Q 2 /V be two down-closed families. If there are a (6, Ci„)-selectable greedy 
OCRS ttinfor a relaxation P ln of P m and a (6, c ou t)-selectable greedy OCRS it ou tf° r a relaxation P ou t of 
Tout, then there is a ((1 — e b — o(l)) • c rn ■ c ou t)-approximation for the submodular stochastic probing 
problem where the order in which elements can be probed is chosen by an almighty adversary and the inner 
and outer constraints are given by T m and T ou t, respectively. Moreover, if ir lr , and Tt ou t are efficient and 
there are separation oracles for P l n and P ou t, then the above algorithm has a polynomial time complexity. 

We remark that the same idea used to derive Theorem l 1.1 8l from Theorem ll.l7l can also be used to derive 
from Theorem l 1.191 a result for the submodular stochastic probing with deadlines problem. 

2 Constructing Online Contention Resolution Schemes 

In this section we prove the existence (or non-existence) of OCRSs for various polytopes. Sections 12.11 
12.21 and 1231 study OCRSs for matroid polytopes, matching polytopes and the natural relaxation of knapsack 
constraints, respectively. The results proved in these sections prove together Theorem 11.81 Theorem 11.91 
which shows that greedy OCRSs for different polytopes can be combined to create greedy OCRSs for the 
intersection of these polytopes, is proved in Section [2~4l 

2.1 OCRS for matroids 

In this section we give a greedy OCRS for matroid polytopes. For standard matroidal concepts such as span, 
rank, contraction and restriction, we refer the reader to Appendix |A| Also recall that, for a given matroid 
M = (N, T), the matroid polytope Pjr is defined by {rz; € K> 0 | MS C N YleeS x e — rank(S')}. The 
main result of this section can be stated as follows. 

Theorem 2.1. Let b £ [0,1]. There exists a (b. 1 — b)-selectable deterministic greedy OCRS for any matroid 
polytope Pjr C [0, 1 ] v on ground set N. 

Combining Theorem 11.91 with Theorem 12.11 we also get a greedy OCRS for the intersection of k ma¬ 
troids. 

Corollary 2.2. Let b £ [0,1], and let Pi,, I\ C [0, 1 ] v be k matroid polytopes over a common ground 
set N. Then there exists a (6, (1 — b) k )-selectable deterministic greedy OCRS for P = n('L, P,. 
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Note that the above corollary implies (by Observation 11.6b that there is a 6(1 — 6) ^-selectable greedy 
OCRS for P. Moreover, choosing b = jjj, in Corollary 12.21 we obtain the following. 

Corollary 2.3. Let P\. ... . P}. C [0,1 ] N be matroid polytopes over a common ground set N, let P = 
0 * =1 Pj, and let c = ^-(1 — > e (k+i) ' Then there exists a c-selectable greedy OCRS for P. 

The rest of this section is devoted to the proof of Theorem l2.ll Consider a matroid M = (IV, P) and let 
Pjr be the associated polytope. Our greedy OCRS is based on using x G Pjr to find a chain decomposition 
of the elements 


0 = Ng C C ■ ■ • C JVi C N 0 = N . 


It then accepts an active element e G Ni\ N l+ \ if e together with the already accepted elements in Ay \ JVj+i 
forms an independent set in the matroid (M /N l+ \) \ , i.e., the matroid obtained from M by contracting 

and then restricting to N r . To see that this OCRS is a greedy OCRS, note that the above algorithm is 
equivalent to defining the family P x = {/ C N : Vi I O (Ay \ W, + 1 ) is independent in (M/Ni + 1 )[a^ }- The 
family T x is clearly a down-closed family of sets (since each (M /N l+ \) \ j^. is a matroid and its independent 
sets are, thus, down-closed). Moreover, P x is a subset of feasible sets because (see, e.g., Theorem 5.1 
in ll23l l if /, is an independent set of {M/N l+ \)\^ i for every i, then the set U,;/,; is independent in M. 
Even though we do not need this fact, we highlight that T x itself describes a family of independent sets of 
a matroid. This follows from the fact that T x is the family of all (disjoint) unions of independent sets in 
the matroids (M/lVj_|_i)| jv* f° r i £ {0,— 1}, implying that T x are the independent sets of the union 
matroid obtained by taking the union of all matroids (M/JVj + i)|jv i for i G {0, — 1}. 

Having shown that the above algorithm is a greedy OCRS for any chain decomposition of the elements, 
we turn our attention to the task of defining a chain that maximizes the selectability of our greedy OCRS. 
For a fixed chain, we have that the selectability of an element e G N t \ N. l+ \ is 

Pr[J U {e} G T x VIC R(x),I G P x ] = Pr[e £ span, ((R(x) n (N t \ N i+1 )) \ {e})] , 

where span,(-) denotes the span function of matroid (M/Ay + i )| ^. Our objective is therefore to construct 
a chain decomposition that maximizes Pr[e 0 span, ((R(x) D (Ay \ Ay + i)) \ {e})] or equivalently mini¬ 
mizes 


Pr[e G spanj ((R(x) O (AT* \ N i+1 )) \ {e})] . (2) 

We now describe an iterative procedure for constructing a chain decomposition so that (O is at most b 
for each element. Initially, the chain only consists of the ground set Ay = N. We need to refine the chain if 
there exists an element e G N such that Pr[e G spanf/ifx) \ {e})] > 6. We do that in a “minimal” way as 
follows: 

• Let S = 0. 

• While there exists e G A r o \ S such that Pr[e G span ((R(x) U S)\ {e})] > 6, add e to S. 

We then let N\ = S. Note that if Ay is a strict subset of A r o then we have made progress and we repeat 
the above procedure (on the matroid induced by AY) to obtain Ap C AY and so on, until we obtain Ng = 0. 
Thus, if we assume that the procedure terminates, then, by construction, the chain satisfies 

Pr[spanj ((R(x) D (N t \ Wj + i)) \ {e})] < 6 for all i and eGJV,\ AYh • 

The rest of this section is devoted to show that the chain construction always terminates. As described 
above, this implies a (6,1 — 6)-selectable greedy OCRS, and thus proves Theorem 12. 11 
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2.1.1 Proof of termination of chain construction 

To prove that the chain decomposition terminates, it is sufficient to show that Aq = S C A r 0 = N for any 
(non-empty) matroid as the chain decomposition then recurses on the matroid induced by N\ (so the same 
argument implies that A^ C N\ assuming N\ f 0, and so on). Notice that the definition of S implies that 
S can only increase as coordinates of x are increased. Hence, it is safe to assume that x G b ■ P B , where 
P B = {x G Pjr | x(N) = rank(A r )} is the base polytope of the matroid M, which is the set of all maximal 
vectors in Pj. 

For proofs in the rest of the section it will be convenient to have the following equivalent view of the 
construction of S = N\ in the refinement procedure. 

• Let Sq = 0, and let Si = {e £ A Pr[e G span ( R(x ) \ {e})] > b} be the set of elements that are 
“likely” to be spanned. 

• Assuming we have defined Sq, Si,, Si- 1 , let 

Si = {e G N | Pr[e G span (( R(x ) U Si-i ) \ {e})] > b} , 

that is, Si contains those elements that are likely to be spanned assuming that the elements of ,S',_ i 
are contracted (or equivalently appear with probability 1). 

Notice that Si -1 C S, for every i > 1, and S t = Si -1 implies S, = Sj for every j > i. Thus, we must have 
N] = S = 5|jv|- The key technical part of the termination analysis is the following lemma. 

Lemma 2.4. It always holds that: 

x e Pr[e G span ( R(x ) U S)] < b ■ ( x(N ) + (1 — b) rank(S’)) . 

e&N 

Moreover, the inequality is strict if S ^ 0. 

Before proving the lemma, let us see that it implies what we want: 

Corollary 2.5. If N f 0 then N\ = S C Ak 

Proof. The corollary is clearly true if 5 = 0. Otherwise, by Lemma [2~4l 

x{S) < x(span (R(x) U S )) = x e Pr[e G span ( R(x ) U S’)] 

e&N 

< b(x(N) + (1 — b) rank(S’)) < 6rank(AQ . 

As x(S) < b ■ rank(Af) and x(N) = b ■ rank(A^) by our assumption that x G bP B , we get x(S') < x(N), 
which implies N \ S 0. □ 

Let us now continue with the proof of the our technical lemma. 

Proof of Lemma \Z4\ Let S' = {ei, e 2 , ■ ■ ■, c-k } be a basis of the matroid M\s obtained by first greedily 
selecting elements from Sq, then greedily adding elements from Si, and so on. Consider the distribution // 
over 2 n defined according to the following sampling procedure: 

1. Let A be a random set originally distributed like R.{x). 

2. For j = 1,2,..., A:, if ej 0 span(A), add ej to A. 

3. Output A. 
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Observe that this sampling procedure guarantees that the distributions of span(5 U Il(x)), span(5' U R(x)) 
and span(H) are identical. Therefore, 

Pr[e £ span (R(x) U S )] = Pr A~n[e G span(A)] . 

Now simple calculations yield 

Y^eeN x e Pl ’A^fi\e € span(A)] = EA~ M [a;(span(.A))] 

< b ■ EA~ /i [rank(span(A))] (using x £ b ■ Pi) 

= b ■ EA~ /i [rank(^)] < b • Ea~ m [|A|] . 

We complete the proof by showing that E_ 4 ^ /t [|H|] < x(N) + (1 — b) rank (S’). To see this, note that 

k 

Ea~ m [|-4|] = x(N) + ^Pr[ej ^ span (R(x) U {ei,..., ey_i})] 
j =i 

< x(N) + (1 — b)k = x(N) + (1 — b) • rank(S) , 

where the inequality follows from the following argument. If we let i be the smallest index so that e 3 £ Si, 

then by the construction of S' we have Pr[ej £ span(R(x) U {ei,...,e^-_i})] > Pr[ej £ span(R(x) U 

5j_i)] > b. Finally, we remark that the strict inequality Pr[ej <G span(/i(.x) U S,_ i)] > b implies that the 
inequality in the statement is strict if S f 0. □ 

Efficient implementation 

The only step that is not constructive in the description of our OCRS for matroids is the computation of 
probabilities of the type Pr[e € span((i?(x) U Si-i ) \ {e})]. One can easily get around this issue by using 
good estimates through Monte-Carlo sampling, leading to the following. 

Lemma 2.6. For any e > 0 and a > 0, there is a randomized construction of a chain 0 = Ay C Nf_ | C 
... CiVi C Nq = N such that with probability at least 1 — |iV| - “ the greedy OCRS defined by the chain 
is (6,1 — b — e)-selectable. Furthermore, the time needed for this construction is 0(a ■ ■ poly (|iV|) • T), 
where T is the time for a single call to the independence oracle of the matroid, and we assume that we can 
sample a Bernoulli random variable in 0(1) time. 

Proof For simplicity we define p e ,s = Pr[e £ span((i?(x) U S) \ {e})] for e £ N and S C N. As before, 
we focus on the construction of N \; the algorithm is then applied recursively. We recall that in the above- 
mentioned construction we set N\ = S, where S was constructed from S = 0 by adding elements e £ N 
satisfying p e ^s > b. To perform this step constructively we will, whenever we need a probability use an 
estimate p e) s obtained through Monte-Carlo sampling. By standard results on Monte-Carlo sampling (see, 
e-g-, fTTTn it suffices to use 0(a ■ \ ■ log |!V|) many samples to obtain a value p £) s such that 

Pr \pe : s £ [p e ,s - CPe,s]\ > 1 ~ lAH" 3 '" • 

Flence, to construct S, we start with 5 = 0 and successively add elements e £ N \ S with p e ,S > b. There 
arc at most \N\ elements we add to 5, and to add one element to 5 we may have to check the values p f ,.s 
of all elements in N \ S. Hence, to construct 5 we use at most 0(|iV| 2 ) estimates of the type p e ,s- At 
the end of this procedure we set N\ = 5 and repeat. Since there are at most 0(| A r |) sets in the final chain 
0 = Ng C ... C Wo = N, the total number of estimates we need is bounded by 0(| A r | 3 ), which implies 
the claimed running time of our algorithm. Moreover, with probability at least 1 — |00| -Q , all our estimates 
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p e> S satisfy p e> g £ [p e ,s ~ e - Pe,s}- To prove the lemma, we assume from now on that all our estimates fulfil 
this property and show that this implies that the OCRS we obtain is (b, 1 — b — e)-selectable. 

Notice that during our construction of S we only add elements e to S satisfying b < p fii s < p e ,s- Hence, 
the elements we add would also have been added to S in the construction that uses the true probabilities 
p e ,s- Therefore, for the same reasons showing that S C N when using the true probabilities p e% s, we also 
have S C N. It remains to observe that at the end of the construction of S, /.<?., when we set N\ = S, the 
probability 1 —p e ,s = Pr[e span((S' U R(x)) \ {e})] of an element e £ N\S being selectable is at least 
1 — b — e. This indeed holds since 


1 - Pe,s > 1 - Pe,S - e > 1 - b-e . 


□ 


2.2 OCRSs for matchings in general graphs 

In this section we describe an OCRS that works for a relaxation Pq of matching in a general graph G = 
(V, E). Specifically, the relaxation polytope Pq is defined as: 



< 1 VuCV 
> 0 V g £ E , 


where 6(u) is the set of edges incident to the node u. Observe that this relaxation is weaker than the matching 
polytope, hence, our results hold also for the matching polytope. We would like to stress that the ground set 
in this section is the set of edges, and thus, unlike in the rest of the paper, we denote it by E. Some ideas 
from the proof of Theorem l2.7l can be traced to offline CRSs given by fl4ll^l 

Theorem 2.7. For every b £ [0,1], there exists a (b. e~ lh )-selectable randomized greedy OCRS for the 
relaxation Pq C [0,1] E of matching in a graph G = ( V. E). 

Proof Let x € bP(; be the input point to the OCRS, and let A ~ R(x) be the set of active elements. 
Our OCRS begins by selecting a subset K of potential edges, where every edge g £ E belongs to K with 
probability (1 — e~ Xg )/x g , independently (observe that this probability in indeed always within the range 
[0,1 ]). Whenever an edge g reveals whether it is active, the OCRS selects it if g £ A D K and the addition 
of g to the set of already selected edges does not make this set an illegal matching. Observe that for any 
fixed choice of K this OCRS is a deterministic greedy OCRS, and thus, for a random K it is a randomized 
greedy OCRS. 

Next, let us show that our OCRS is (6, e~ 2b )-selectable. Consider an arbitrary edge g' = uv £ E. We 
need to prove that with probability at least e~ 2fc the edge g' is in K, and can be added to any matching which 
is a subset of A Cl K. Formally, we need to prove: 

Pr \g' £ K,AnKH ( 6{u ) U 6(v) \ {c/}) = 0] > e~ 2b . 

Clearly, every edge g £ E belongs to A D K with probability x g ■ (1 — e~ Xg )/x g = 1 — e~ Xg . Since the 
membership of every edge in K and A is independent from the membership of other edges in these sets, we 


get: 


Pr[g' € K, A n K C\ (5(u) U 5(v) \ {</}) = 0] = Pr[</ £ K] ■ Pr [g<fAnK] 


gGS(u)LlS(v)\{g'} 




10 . 


'The details of these CRSs are omitted in Ifl4l . but can be found in ED. 
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where the first inequality holds since the membership of x in bP(; guarantees that the total x-values of the 
edges in S(u) \ {</} (or 5(v) \ {</}) is at most b — x g >. □ 


Remark: If one is interested in a deterministic greedy OCRS, it is possible to set K equal to E determin¬ 
istically in the greedy OCRS described by the last proof. A simple modification of the proof shows that the 
resulting deterministic greedy OCRS is (6, (1 — 6) 2 )-selectable. 


2.3 OCRSs for knapsack constraint 

In this section we consider the problem of defining an OCRS for a polytope P C [0, l] v defined by a single 
knapsack constraint. That is, each element e £ N has an associated size s e £ [0,1] and P is defined by 

YleGN s e x e < 1 

x e £ [0,1] for e € N . 

We begin with an interesting simple observation. 

Proposition 2.8. For every n > 1, there exists a knapsack constraint over a ground set of n elements such 
that no deterministic greedy OCRS for the polytope defined by this constraint is (6, c)-selectable for any pair 
ofb£ [0,1] and c > (1 — 6) n_1 . 

Proof. Consider the knapsack constraint defined by the ground set N = {1, 2,... , n} and sizes s\ = s 2 = 
• • • = s n -1 = 1/n, s n = 1. Assume towards a contradiction that there exists a deterministic greedy OCRS 
that is (6, c)-selectable for some b £ [0,1] and c > (1 — 6) n_1 , and consider the family T x of feasible sets 
used by this OCRS for the possible input x\ = xi = ■ ■ ■ = x n -i = 6, x n = b/n. 

Since the OCRS is (6, c)-selectable for c > 0, each element e £ N must be included in at least one set 
of the family P x . Thus, by the down-monotonicity of T x it must contain the set {e} for every e £ N. On 
the other hand, for every e £ N \ {n} we have {e, n} f P. and thus, also {e, n} 0 T x . Combining all these 
observations, we get: 

Pr [I U {n}£P x V / C R(x),I £ P x \ < Pr[e 0 R(x) V e £ N \ {n}] = (1 - h)”" 1 < c , 


which contradicts the (6, c)-selectability of the assumed OCRS. □ 

The next theorem shows that randomized greedy OCRSs can do much better. Some of the ideas used by 
this theorem can be traced back to an offline CRS presented by fTOl for knapsack constraints. 

Theorem 2.9. For every b £ [0,1/2], there exists a (b. -selectable randomized greedy OCRS for any 
polytope P defined by a knapsack constraint. 


Proof. Let x £ bP be the input point to the OCRS, and let N\,i g = {e £ N \ s e > 1/2} be the subset of 
elements that are big. We use &big to denote the total part of the knapsack occupied by big elements in the 
fractional solution x. Formally, 


&big — 


£ 


Sp-^P. 


eeiVbig 


Observe that 6big is always within the range [0,6]. The randomized greedy OCRS we use is defined as 
follows. With probability pbig accept greedily the elements of Akig while respecting the knapsack inequality, 
where pbig is the probability 

1 - 26 + 26 big 
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With the remaining probability accept greedily the small elements of N \ JV b i g while respecting the knapsack 
inequality. It is easy to see that this OCRS is indeed a randomized greedy OCRS. 

We continue to analyze the selectability of the above OCRS. Observe that for any big element e' £ N^ g \ 


Pr[/ U {e'} £ P x 


MIC R(x), I £ P x ] > Pr 


{e } £ PxiYleeR{x) niVbi g Se — Se ' 


( 3 ) 


The event {e'} £ P x is simply the event that the OCRS decides to accept big elements. Given that this event 
occurs, the condition YleeR{x)nN ■ s e < 1 — s e' guarantees that for every subset / of R(x) 0 A r b, g one can 
add the element e' without violating the knapsack constraint. We can lower bound @ as follows. 


Pr 


{e'} £ P x , E 


eeR(x)nN hi ^ 


S e < 1 — S. 


= pbig ■ Pr[.R(x) PI (Wbig \ {e'}) = 0] 


> 


1-2 6 + 26 , 


big 


2-26 


(1 x(Wbig)) > 


1 - 26 + 26 bl 


ig 


2-26 


(1 - 26 big ) > 


1 - 26 
2-26 


where the first inequality follows from the union bound and the second inequality uses the fact that s e > 1/2 
for every e £ lY b i g . Similarly, for an element e 0 iY b i g we have: 


Pr [I U {e'} £ V I C i?(x), / £ J 7 *] > Pr {e'} £ Eeefl(*)\JV bi „ Se - 1 “ s e' 


> (1 - Pbig) • Pr[s(i?(x) \ (Wbig U {e'})) < 1/2] > ( 1 - 

1 - 26 big , , , x 1 - 26 

=-— •(1 - 26 + 26 big ) > - , 

2 - 26 v g ' “2-26 ’ 

where the third inequality follows from Markov’s inequality. 


1 - 26 + 26 b 


ig 


2-26 


1 - 


6 — 6 , 


’big 


1/2 


□ 


2.4 Combining constraints 

Like offline CRSs (see ifhOlO . greedy OCRSs can be combined to form greedy OCRSs for more involved 
constraints. 

Definition 2.10. Given two greedy OCRSs 7T 1 and n 2 for polytopes P\ and P 2 , the combination ofir 1 and tt 2 
is a greedy OCRS -k for the poly tope P = Pi Cl P- 2 - For every input x £ P, tt is defined by the down-closed 
family JCr.x = P^,x n ErV 

Theorem 1 1.9l is an immediate implication of the next lemma. 

Lemma 2.11. Let 7 r 1 and P 2 be (b, c\ )-selectable and (6. (^-selectable greedy OCRSs, respectively. The 
combination ofir 1 and 7 r 2 is (6, c\ ■ C 2 )-selectable. 

Proof Let P\ and If be the polytopes of 7T 1 and 7r 2 , respectively. Additionally, let x £ b(P\ Cl Pf), and let 
e be an arbitrary element of N. We need to prove that: 

Pr [I U {e} £ P T p^ x n P^ x MI C R(x),I £ P n y x Cl P n iJ >c 1 -c 2 . 

For ease of notation, let us denote by \ e (A, J 7 , P') an indicator for the event that I U {e} £ P for ev¬ 
ery set I C A obeying I £ P'. Using this notation, the inequality that we need to prove becomes: 

f > r[Xe(-^(^')) -Ftt 1 ,x C P-r 1 , x 1 Err 1 ,x C P-k 2 ,x)\ f Cl ' C2- 

On the other hand, observe that x £ b{P\ D If ) C bP\. Hence, the (6, ci)-selectability of 7T 1 implies 
that: 


Pr[Xe(R(x),P 7r y x ,P 7r l tX nP n 2 tX )\ > Px[Xe(R{x),P k! >x ,P n-1,2;)] 

= Pr [I U {e} £ P v y x MIC R(x),I £ P x y x ] > ci . 
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where the first inequality follows since Xe is a non-increasing function of its third argument (when the other 
two arguments are fixed). Similarly, we also get: Pr[x e (f?(x), F^z x , F n 1 x n F~i > C 2 . Next, observe 
that Xe is also non-increasing in its first argument (when the other two arguments are fixed). Hence, if we 
let R be a random set distributed like R(x), then, by the FKG inequality: 

Pr [x e (R(x),F n i tX n J>2 jX , J>i )X n f v 2 x )\ 

R r [Xe(Ri ^ Xe{Rj •F-k' 1 ,xi ,x ^ *^ 7 r 2 ,a:)] 

> Pl\Xe(R(x),^, x ,^l, x n^2 tX )} ■Pr[Xe{R(x),J r n 2 }X ,J r n l tX nJ 7 n 2 }X )\ >C 1 -C 2 . □ 

3 From Selectability to Approximation 

In this section we prove Theorems 11.101 and 11.111 which study the relation between the value of a vector 
x and the the expected value of the output produced by an OCRS given this vector as input. Following 
is a restatement of Theorem 11.101 Unlike the original statement of the theorem, this restatement uses the 
notation S(p), where S is a set and p is a probability, to denote a random set containing every element e £ S 
with probability p, independently. Observe that S(p) has the same distribution as Rip • I 5 ). 

Theorem ll.101 Given a non-negative monotone submodular function f : 2^ —> ]R>q and a ( b , c)-selectable 
greedy OCRS for a poly tope P, applying the greedy OCRS to an input x £ bP results in a random set S 
satisfying E[/(S')] > c-F(x), where F is the multilinear extension of f. Moreover, even iff is not monotone, 
E[/(5(l/2))] > (c/4) • F(x), where the random decisions used to calculate 5(1/2) are considered part of 
the algorithm, and thus, known to the almighty adversary. 

To prove Theorem 1 1.1 01 we need to define some concepts regarding offline CRSs. Recall that a CRS for 
a polytope P is a (possibly random) function 7 r: 2 V —> 2 v that depends on an input vector x £ P, and for 
every set S C N returns a subset 7 r(5) C S that obeys the polytope P (/.<?., l^s) £ P). 

Definition 3.1. A CRS n for a poly tope P is: 

• (6, c)-balanced some for b,c € [0,1] if Pr[e £ 7 t(R(x)) \ e £ R(x)] > c ■ x e whenever the input 
vector x belongs to bP and x e > 0. 

• monotone //Pr[e £ 7t(5i)] > Pr[e £ 77 (^ 2 )] whenever e £ S\ C S 2 - 

We now define and analyze an interesting notion that allows us to connect the world of OCRSs with that 
of CRSs. 

Definition 3.2 (characteristic CRS). The characteristic CRS it of a greedy OCRS it for a polytope P is a 
CRS for the same polytope P. It is defined for an input x £ P and a set A C N by fr( A) = {e £ A \ 
I U {e} £ F KjX VI C A, I £ F n-,*}- 

The following observation shows that 7 r(H) obeys the poly tope P and tt(,4) C A. Thus, the character¬ 
istic CRS 7r is a true CRS for the polytope P. 

Observation 3.3. For every set A C N and a characteristic CRS It of a greedy OCRS 7 r, the set 7t( A) is 
always a subset of the elements selected by it when the active elements are the elements of A. 

Proof Fix an element e £ It (A), and let T be the set of elements selected by the greedy OCRS 7r imme¬ 
diately before e reveals whether it is active. The definition of It{A) guarantees that T U {e} £ F^. x since 
T £ F^, x , and thus, e is accepted by 7 r. □ 
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Lemma 3.4. The characteristic CRS it of a (h,c)-selectable greedy OCRS ir is (b, c)-halanced and mono¬ 
tone. 

Proof. Let P denote the polytope of the greedy OCRS it (and its characteristic CRS ft), and fix a vector 
x E bP. Since it is (6, c) -selectable, we get for a set A distributed like R(x) and an arbitrary element 
e £ N: 

Pr[e E ft {A) \ e E A] = Pr[7 U {e} E V I C A, I E | e E A] 

= Pr[J U {e} E P-k.x VICA,1e > c . 

The last inequality implies, by definition, that ft is a ( b , c)-balanced CRS. 

Next, let us prove that tt is monotone. Fix an instantiation of an element e E N and two sets 
e E j4i C A 2 C iV. If e E vf(^42)> then we know that I U {e} E Pw,x for every I C A 2 ,1 € J> jX . Thus, 
clearly, I U {e} E P n! x for every / C A\ C ^4 2) I C Jv ;X , which implies e E vf(^4i). In summary, we got 
that: 

e E 7f (^ 2 ) ^eE 7f(Ai) , 

and thus, even when we do not fix the instantiation of 

Pr[e E 7r(^4 2 )] < Pr[e E tt(Ai)\ , 

which completes the proof that tt is monotone. □ 

To continue the proof of Theorem 11.101 we need to state some known results. The following lemma 
follows from the work of iflOl (mostly from Theorem 1.3 in that work). 

Lemma 3.5. For every given non-negative submodular function f: 2 N —> R>o, there exists a function 
rjj: 2 N ^ 2 n that always returns a subset of its argument (i. e., t]f(S) C S for every S C N) having the 
following property. For every monotone ( b , c)-balanced CRS it for a polytope P and input vector x E bP: 

E[f(rj f (TT(R(x))))} > c ■ F{x) , 

where F (x) is the multilinear extension of f. 

The following two known lemmata about submodular functions have been rephrased to make them fit 
our notation better. 

Lemma 3.6 (Lemma 2.2 of 1121 ). Let g: 2 ;V —>• R be a submodular function, and let T be an arbitrary set 
T C N. For every random set T p C T which contains every element ofT with probability p (not necessarily 
independently): 

K[g(T p )]>(l-p)g(0)+p-g(T) . 

Lemma 3.7 (Lemma 2.2 of El). Let g: 2 N —> R>o be a non-negative submodular function. For every 
random set N p C N which contains every element of N with probability at most p (not necessarily inde¬ 
pendently): 

E[s(jVp)]>(l-p) fl (0) . 

We are now ready to prove Theorem 1 1.101 

Proof of Theorem \L10\ Let ft be the characteristic CRS of the OCRS vr we consider, and let A ~ R(x) be 
the set of active elements. For notational convenience, let us also denote by S' the set rjf(Tt(A)). Notice that 
S' is a subset of the set S of accepted elements since 7t( A) is a subset of S by Observation 13.31 Lemmata l3.4l 
and 13 .5 l imply together the inequality E[/(S")] = E//(///(7f(,4)))] > c ■ Fix). To complete the proof of the 
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first part of the theorem, it is now enough to observe that by the monotonicity of /: E[/(5)] > E[/(5')] > 
c • F(x). 

To prove the second part of the theorem, let us fix the set A and the family F niX which, for brevity, we 
denote by T x in the rest of the proof. Observe that the set S' is deterministic once A and T x are fixed, and let 
us denote this set by S' A -p . Hence, we can think of 5(1/2) as obtained by first calculating a set S' A -p (1/2) 
containing every element of S A p x with probability 1/2, independently, and then adding to it a random set 
A C N \ S' A:F . By controlling the order in which elements reveal whether they are active, the adversary 
can make the distribution of A depend on S' A (1/2); however, A is guaranteed to contain every element 
with probability at most 1/2 for every given choice of S A j- (1/2). Using this observation we get: 


E[/(5(l/2)) | A, T x \ = E[/(5'(l/2) U A) | A, F x \ 

= ^ p r[5^(!/2) = B | A,F x ]-E[f(B U A) | 5^ (1/2) = B,A,F X ] 


B ^x x 


> ^Pr[5^(l/2)=5| A,F X 

b ^ s 'a,x x 

E[/(5') | A,F X ] 


E [f(B) | A,T x \ _ E[/(S'(l/2)) | A,T X 


> 


where the first inequality follows from Lemma [3771 since the function ti^(T) = f(B U T) is non-negative 
and submodular for every set B C N, and the second inequality follows from Lemma 13,61 Taking an 
expectation over the possible values of the set A and the family T x , we get: 


E[/(5(l/2))] =E A ^[E[/(5(l/2)) | A, F x \] 
^ fE[/(5') | A,F X ] 


Notice that the result proved by Theorem 11.101 for non-monotone functions loses a factor of 4 in the 
guarantee. To avoid that, we also consider online adversaries. Unfortunately, we do not have an improved 
result for greedy OCRSs against online adversaries. Instead, we study the performance of a different family 
of ORCSs against such adversaries. 

Definition 3.8 (element-monotone OCRS). An element-monotone OCRS is an OCRS characterized by a 
down-closed family T u C 2 V \M j or ever y element e € N, where the families {fF, },:e,v can be either 
deterministic (a deterministic element-monotone OCRS) or taken from some joint distribution (a randomized 
element-monotone OCRS). Such an OCRS accepts an active element e if and only if A <e € J~ e , where A <e 
is the set of active elements that revealed that they are active before e does so. 

One can observe that all the results we prove for greedy OCRSs in this paper can be easily applied also 
to element-monotone OCRSs with the following modified definition of (6, c)-selectability. 

Definition 3.9 (( b , c)-selectability for element-monotone OCRSs). Let b,ce [0,1], An element-monotone 
OCRS for P is (b. c)-selectable if for any x € b ■ P we have 

Pr[5(x) \ {e} € F e ] > c Me e N . 


E lf(S')] 


> (c/4) • F(x) 


□ 


Moreover, the greedy OCRSs we describe for specific polytopes can be converted into similar element- 
monotone OCRSs with the same (b, c)-selectability guarantee (in fact the greedy OCRS we describe for 
matroids is already an element-monotone OCRS without any modifications). Our objective in the rest of 
this section is to prove the next theorem. Notice that Theorem ll.l ll is a special case of this theorem. 


18 













Theorem 3.10. Given an element-monotone ( b , c)-selectable OCRS tt and a non-negative submodular func¬ 
tion f: 2 V —» R>o, there exists an OCRS tt' that for every input vector x £ bP and online adversary selects 
a random set S such that E[/($))] > c • F{x). 

To prove Theorem l3.10l we need some notation. Let a a denote an arbitrary fixed absolute order over the 
elements of N. Given element e £ N and a vector y £ [0,1 ] v , let F(e \ y ) denote the marginal contribution 
obtained by increasing the coordinate of e in y to 1. Formally, F(e \ y) = F(y V l{ e }) — -F(y). Finally, we 
say that x is non-reducible if F(e \ x A l (T <e) > 0 for every element e £ AT having x e > 0, where af e is 
the set of elements that appear before e in the order a a . 

Observation 3.11. If x is reducible, then there exists a non-reducible vector x' < x obeying Fix') > F(x). 

Proof Consider the vector x' obtained from x by the following process. Start with x' £- x. Scan the 
elements in the order a a . For every element e, if F(e \ x ! A l CT < e ) < 0, then reduce x' e to 0. Clearly this 
process ends up with a non-reducible vector x'. Moreover, every step of the process only increases the value 
of F(x'), and thus, this value ends up at least as large as its initial value Fix). To see why this is the case, 
consider a step in which the value of x' e is reduced to 0 for some element e £ N, and let x 1 and x 2 be the 
vector x' before and after the reduction. Then, 

Fix 1 ) = /(0) + V x\, ■ F{e' | x 1 A 1 <e >) < /(0) + V x\, ■ F{e' | x 1 A 1 <«/) 

^ * u a < u a 

e'&N e'6JV\{e} 

< fi 0 ) + X e'' F ^ I X2 A 1 a< E ') = ’ 

• ^ u a 

e'£N\{e} 

where the first inequality holds since F[e \ x 1 A l CT <e) < 0, and the second inequality holds by submodu¬ 
larity. □ 

Observation [3JJ] shows that it is enough to prove Theorem 13,101 for non-reducible x. If x is reducible, 
the OCRS 7r 7 can calculate a non-reducible x' having Fix') > F(x), and then “pretend” that some active 
elements are in fact inactive in a way that makes every element e active with probability x', independently. 
Determining x' requires exponential time, but even if one wants a polynomial time OCRS it' it is possible 
to use sampling to get, for every constant d > 0, a non-reducible vector x' having Fix') > Fix) — A r |~ ' ; • 

max{/({e}) | x e > 0}. _ 

The OCRS tt' we use in the proof of Theorem [3T0] works as follows: whenever n' learns that an element 
e is active it complements the set A <e to have the distribution R{x A ljv\{ e })> ar *d then checks whether the 
resulting random set is in F e . More formally, let a be the order in which the elements reveal whether they 
are active, and let a >e be the set of elements that appears after e in the order a. Then, when e reveals that 
it is active, the OCRS tt' decides to accept it if A <e U II(x A 1^»- ) £ F e (for a random realization of the 
random set R(x A l a >e). 

Observation 3.12. The OCRS tt' always selects a set S £ F. 

Proof Fix the set A of active elements, the families {F e }e&N and the order a in which elements reveal 
whether they are active. We prove that the observation holds for any possible choice for these fixed values. 

Let S' be the set of elements selected by tt. The fact that tt' selects some element e £ N (i.e., e £ S) 
means that (5 0 a <e ) U fi(x A £ F e for some realization of the random set R(x A 1„>«). Hence, 

S (~l a <e £ F e , which implies that 7r also selects e {i.e., e £ S'). This argument implies that S C S'. The 
observation now follows by the down-monotonicity of T since 7r always returns a set in F. □ 

Next, we need to prove the following technical lemma. 
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Lemma 3.13. Let X\, X 2 be two random sets that never contain elements e, e! G N. Additionally, let Y\ 
and Y 2 be two random sets distributed like R(x A l{ e '}) which are independent from each other and from 
X 1 , X 2 and X e . Then, assuming Pr [X 2 G X,] > 0, 

E [f{e | X 2 U li) | X 2 U Y 2 G X e ] < E[/(e | X x U Yi) | X 2 U Y 1 G X e ] . 

Proof It is enough to prove the lemma for fixed values of X\, X 2 and X, obeying X 2 G X e . If X 2 U { e' } G 
X e , then the conditions X 2 U Y 2 G X e and X 2 U Y\ G X e always hold and the lemma is trivial, thus, we also 
assume X 2 U { e '} 0 X e . Then, conditioned on the values of X\, X 2 and X e : 

E[/(e | X x U Yi) | X 2 U Y 2 G X e ] < E[/(e | X 2 ) | X 2 U Y 2 G X e ] = E[/(e | X x ) | Y 2 = 0] 

= E[/(e | Xi U Yx) | Y 1 = 0] 

= E[/(e | X 1 U Yi) | X 2 U Yi G X e ] , 


where the inequality holds by submodularity. □ 

Using the last lemma we can now prove the following one, which lower bounds the contribution of an 
element e to the value of the solution selected by X. 

Lemma 3.14. Let A ~ ll{x) be the set of active elements, and let S be the output of X given A and 
an arbitrary online adversary. Then, for every element e G X having x e > 0 and Pr[0 G Xf\ > 0, 
Pr[e G S | e G A\ = Pr[i?(x) \ {e} G X e \ andK[f(e \ A D crf e ) \ e G S] > F(e \ x A l CT <e). 

Proof Observe that the conditions x e > 0 and Pr[0 G X,] > 0 arc equivalent to Pr[e G S] > 0, and 
thus, the second expectation we want to bound is well defined for every element e having x e > 0 and 

Pr[0 G X e ] > 0. 

The strategy of an online adversary for determining the order in which elements reveal whether they arc 
active, up to the point when the element e does so, can be characterized by a binary tree with the following 
properties: 

• Every leaf is marked by e. 

• Every internal node is marked by some other element e' X e an ^ has two children called the “accepted 
child” and the “rejected child”. 

• The path from the root of the tree to every leaf does not contain a single element more than once. 

The semantics of understanding the tree as a strategy arc as follows. The adversary starts at the root of the 
tree, and moves slowly down the tree till reaching a leaf. When the adversary is at some node e! it makes e' 
the next element that reveals whether it is active. If e! is accepted by the OCRS, then the adversary moves to 
its “accepted child”, otherwise it moves to its “rejected child”. Notice that strategies defined by such trees 
do not allow the adversary to use the information whether e' was active or not when the OCRS rejects it, 
however, since the activation of elements is independent and our OCRS behaves in the same way under both 
cases, this information cannot help the adversary. 

In the rest of this proof, we show by induction on the number of leafs in the strategy of the adversary 
that the lemma holds for every online adversary. Let us staid with the case of the single strategy having a 
single leaf. In this strategy the adversary makes e the first element to reveal whether it is active. This means 
that: 

Pr[e G S | e G X] = Pr[R(x) \ {e} G X e ] , 

and 


E[/(e | Ad er^ e ) | e G S’] = E[/ (e 

= E[/(e 


A Cl a^ e ) | R{x) \ {e} G X e , e G A] 
^no-< e )] = F(e | xAl a <e) , 
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where the second equality holds since A n a^ e is independent of the conditions R(x) \ {e} G T, and e G A. 

Next, assume the lemma holds for strategies having i — 1 > 1 leaves, and let us prove it for a strategy 
T having t leaves. Since every internal node of T has two children, T must contain a node w (marked by 
an element e' ^ e) having two leaves as children. Let T' be the strategy resulting from T by removing the 
two children of w and making w itself a leaf (by marking it with e). Since T' has l — 1 leaves, it obeys the 
lemma by the induction hypothesis. Hence, it is enough to show that Pr[e G S \ e G .4] is identical under 
both T and T' and IE[/(e | A n cr^ e ) | e G S'] is at least as large under T as under T'. 

Let Xw be the event that the adversary reaches the node w in its strategy. Clearly Prfy,,, | T] = Pr[y !( , | 
T'], where by conditioning a probability on a strategy of the adversary we mean that the probability is 
calculated for the case that the adversary uses this strategy. If the last two probabilities are strictly smaller 
than 1 we also have: 


Pr[e G S | e G A, -<Xw, T] = Pr[e G S \ e G A, Xw , T'] ■ 

On the other hand, observe that for both strategies T and T' the event \ w implies the same (deterministic) 
fixed values for the set B w of the elements that revealed whether they are active up to the point that the 
adversary reached w, and the set A w = A n B w . Thus, whenever Pr[y„, | T] = f'r[y u , | T'\ > 0: 

Pr[e G S | e G A, Xw,T'] = Pr[H„, U ( R(x ) \ ( B w U {e})) G T e ] 

= Pr[Au, U(ifl {e'}) U (R{x) \ (B w U {e, e'})) G F e ] = Pr[e G S \ e G A, Xw, T] . 


In conclusion, we got: Pr[e G S \ e G A, T] = Pr[e G 5 | e G A,T']. Notice that both probabilities must 
be strictly positive by the induction hypothesis. 

By Bayes’ law we now get: 


Pr[x™ I T, e G S] = Pr[x™ 
= Pr[e G S | e G A, T', Xw] ■ 


| e G A, T, e G S] = Pr[e G S 

Pr[x w | e G A, T'] r 
Pr[eeS|eeAT] = Pr[X ” 


e G A, T, Xw] 


Pr[x^ | e G A, T] 
Pr[e G S | e G A, T] 


e G A,T',e G S\ = Pr[x w | T', e G S\ , 


and when the probabilities Pr[x«, | T,e G 5] = Pr[y„, | T'■ e G S'] are strictly smaller than 1 we also have: 

E[/(e | A 0 a< e ) | e G S, T] = E[/(e | A O rx< e ) | e G S, -> X w,T'] . 

Hence, to prove that E[/(e | A fl rj^ e ) | e G S] is at least as large under T as under T' we are only left to 
show the inequality: 


E[/(e | A 0 rr< e ) | e G S, X w, T] > E[/(e | A n a< e ) \eES, Xw , V] 


whenever Pr[x«, T, e G S] > 0. The last inequality holds since: 


W(e 


= E 
< E 


/(e 

/(e 


= E[/(e 


Ana< e )\eeS, Xw ,T'] 
(A w U (A \ B w )) n a< e ) 

{ A w U (A \ B w )) n a< e ) 
Hncr< e ) | e G S,Xw,T] 


A w U ({R(x) \ B w ) \ {e}) G T e 

^i»U(An {e'}) U ((R(x) \ B w ) \ {e', e}) G T e 


□ 


where the inequality holds by Lemma l3.131 
We are now ready to prove Theorem 13 .101 
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Proof of Theorem [3. 10\ If c = 0, then the theorem is trivial. Thus, we may assume c > 0. Recall that S 
is the set produced by the OCRS tv', and let A ~ R(x) be the set of active elements. Since, tv is a ( b , c)- 
selectable element-monotone contention resolution scheme, A \ {e} must belong to T e , for every element 
e E N, with a positive probability. By the down-monotonicity of J>, we get that 0 6 J e for every e E A r . 
Next, observe that: 

nf(S)] = f(0) + ]T Pr[e € 5] • E[/(e | 5 0 a< e ) | e € 5] 
eeN,x e > 0 

>/(0)+ E Pr[e € S] • E[/(e | A n cr< e ) | e E S] 

eeN,x e >0 

> f(0) + E Pi[R(x) \ {e} E e £ A] ■ F(e \ x A l ff <e) 

e£N,x £ > 0 

= Z(0) + E Xe • Pr[i?(x) \ {e} E Jy,] • F(e | x A l^e) . 

eeN,x e > 0 

where the first inequality holds by submodularity and the second by Lemma 13.141 Since tv is a (b. c)- 
selectable contention resolution scheme, the probability Pr[i?(x) \ {e} € F e ] must be at least c for every 
element e € N. Additionally, since we assumed that x is non-reducible, we also have F(e \ x n l (T <e) > 0 
for every element eEJV obeying x e > 0. Plugging both observations into the previous inequality gives: 

E[/(5)] > /(0) + E c-x e -F(e\xA l a <e) = c • F(x) + (1 - c) • /(0) > c • F(s) . □ 

eGN,x e >0 

4 Details on applications 

In this section we prove the theorems stated in Section 11.31 and provide some additional information. We 
reuse notation introduced in Section [L3l 

4.1 Prophet inequalities for Bayesian online selection problems 

Proof of Theorem 11.121 

We start by introducing a relaxation for the expected value of the prophet, i.e., E[max{^ eg5 Z e I ^ € F}]. 
Similar relaxation techniques to the one we use here have been been used previously for different related 
problems (see, e.g., |[24l l). 

Let I* E argmax{^ eg/ Z, \ I 6 T} be an optimal (random) set for the prophet, and we define 
p* = Pr[e E I*] for e 6 iV. Our relaxation seeks probabilities p e that have the role of p*. Observe first 
that since I* E T with probability 1, we have that p* is a convex combination of characteristic vectors of 
feasible sets, and hence, p* E P (we recall that P is a relaxation for P). 

Our relaxation assigns an optimistic objective value to each probability vector p E P. More precisely, 
for any e 6 Awe assume in the relaxation that element e gets selected when Z, takes one of its p e -fraction 
of highest values. In particular, if Z e follows a continuous distribution with cumulative distribution function 
F e , then we assume that Z, gets selected whenever Z e > q e := F f 7 1 (1 — p e ) and, consequently, the 
contribution of e to the objective of the prophet is g e (p e ) = j f; °° x ■ dF e (x). More generally, when Z e does 
not follow a continuous distribution, the expected value of Z e on the highest p e -fraction of realizations can 
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be described as follows: 


9e{Pe) 


(Pe - (1 - Fe(q e ))) ■ Qe + 


' x£(q e ,oo) 


x ■ dF e (x), 


where 


Qe = QeiPe ) = min{a | F e (a) > 1 - p e } ■ 


In words, we assume that e gets selected whenever Z e > q e . Moreover, if Z e = q e , then e gets selected with 
probability p e - 1 + F e (q e ). 

Putting things together, the relaxation we consider is the following. 


max 

p€-P 


Y 3e{Pe) 

e&N 


(4) 


By the above discussion this is indeed a relaxation. Moreover, one can easily observe that g e is a concave 
functions, and thus, in many settings one can efficiently obtain a near-optimal solution to this relaxation 
using convex optimization techniques. However, if we are only interested in proving the existence of a 
prophet inequality as stated in Theorem ll.121 we do not need an efficient procedure to solve ©. 

Let x £ P be an optimal solution to ©. We now create an algorithm for the Bayesian online selection 
problem based on the point x £ P and the c-selectable OCRS for P which exists by assumption. Whenever 
an element e £ N reveals in the Bayesian online selection problem we say that e is active if its random 
variable Z e realizes within the largest ay -fraction of realizations. More formally, e is active if either: 


(i) Z e > q e {x), or 

(ii) if Z e = q e (x) (assuming Pr[Z e 

- x e -l+F e (q e {x)) 

Probability Pr [ Ze = qe ( x )\ • 


q e (x)] > 0), we toss a coin and declare e to be active with 


Let A C N be the random set of active elements. Observe that A is distributed like R(x), the random subset 
of N that contains each element e € N with probability x e independently of the others. Also, by definition 
of active elements we have 

^[Z e ■ l e&A ] = g e (x e ) Ve G N . (5) 

Our algorithm for the Bayesian online selection problem applies a c-selectable OCRS to the set A to obtain a 
random set I C A, / € T. To prove the theorem, we show that the expected value of / is at least a c-fraction 
of the optimal value of ©, i.e ., E[X ee / Z e ] > c ■ Xeetv 9e{x e )- 
Since the OCRS is c-selectable, we have 


Pr[e € I\ > c ■ x e Me £ N . (6) 

A key observation is that the distribution of Z e conditioned on e G / is the same as the distribution of Z f 
conditioned on e € A. This follows from the fact that the OCRS does not consider the precise value of Z e , 
but only knows whether e £ A or not. In particular, this implies 

E[Z e | e £ I] = E[Z e \ e £ A] Me £ N . (7) 
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Combining the above observations we get 


E 


E z « 

.eel 


= Y Pr[e € /] • E[Z e \ e £ I] 

eeN 


> c ■ x e ■ E [Z e \ e € A] 

(by © and £7]) ) 

eeN 

= C ■ Y Pr I e G A] ' E l z e ■ 1 eeA | e <E A] 

(since Pr[e G A] 

eeN 

= c■ Yde(Xe) 
eeN 

(by©) . 


Xe) 


The last inequality shows that our procedure is worse by at most a factor of c compared to the value of the 
relaxation ©, which completes the proof. 

4.2 Oblivious posted pricing mechanisms 

Proof of Theorem 11.15| 

The proof for Theorem l 1.151 goes along the same lines as the proof of Theorem 11.1 2l prcscntcd in Section l4~Tl 
but uses a different relaxation. The relaxation we employ is the same as the one used by Yan (24l . For 
completeness and ease of understanding we replicate some of the arguments in lf24l and refer to the excellent 
discussion of this relaxation in (241 for more details about it. 

Consider the random set of agents I* C N, I* € F served by Myerson’s mechanism, i. e ., an optimal 
truthful mechanism, and let q* = Pr[e € I*] be the probability that e gets served. Since only feasible 
subsets of agents can be served, we have q* € P, because P is a relaxation of F. 

For this fixed q* we can now define independent mechanism design problems for the different agents 
as follows. For each e £ N, we are interested in finding a price distribution (for the price offered to e), 
that maximizes the expected revenue under the constraint that e gets served with probability equal to q*. 
Based on results by Myerson (22l . it follows that the optimal price distribution can be chosen to be a two- 
price distribution, which can be determined through a well-known technique in mechanism design known as 
ironing (we refer to l24l for details). We denote by R e {q* e ) the expected revenue of this optimal distribution, 
which can be shown to be concave in q*, and by V e (q*) the distribution itself. Since the family of these 
independent mechanism design problems for the agents is less constrained than the original BSMD, in which 
we also had to make sure that the set of all served agents is in F, we have that YleeN ^e{<f e ) * s an u PP er 
bound to the expected revenue of an optimal mechanism for the original BSMD (we refer to l24l for a formal 
proof). Hence, the following is a convex relaxation of the original BSMD. 



The COPM we construct needs probabilities x £ P such that ^£ egJV ( Xf: ) ' s an u PP er bound on the 
revenue of Myerson’s mechanism. By the above discussion, this holds for x = q*, or for x being an optimal 
solution to ©. To make this step constructive one can follow, for example, the sampling-based approach 
of Chawla et al. (91; they estimate the probabilities q* by running Myerson’s mechanism sufficiently many 
times. Alternatively, one could use convex optimization techniques to optimize the relaxation (fSl)l 1 1 Our 

u We highlight that even if only an approximately optimal x € P can be obtained, i.e., one such that a ■ Re{x e ) upper 

bounds the optimal revenue for some a > 1, then all of what follows still goes through simply with an additional loss of a factor 
a. This will lead to a COPM that is at most a factor of a ■ c worse than Myerson’s mechanism. 
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COPM is randomized and defined by the following randomization over tuples (p, F'). The price vector 
P € ^> 0 is drawn according to the product distribution 'X. eGN T> e {x e ), where each p e for e £ N is drawn 
independently according to the two-price distribution T> e (x e ). The family F’ is chosen to be equal to the 
family F x of the c-selectable OCRS for the point x £ P. Hence, if our OCRS is deterministic, then also 
F’ = F x is deterministic, in which case the randomization of our COPM is solely on the price vector p. 

To prove Theorem 1 1.151 we show that our COPM has an expected revenue of at least c • YleeN Re(x e ). 
We call an agent e £ N active if its personal (random) valuation Z e is at least as large as the (random) 
price p e . In other words, we say that e is active if it would accept the offer presented by our COPM. By the 
definition of the distributions V e (x e ), we have that each agent e is active with probability x e , independently 
of all other agents. Notice that an agent e £ N being active does not imply that e gets selected, because a 
COPM is allowed to reject an agent if feasibility in F’ is not maintained. However, because our OCRS is 
c-selectable, we have that for any e £ N with probability at least c, the agent e can be added to the agents 
served so far no matter which subset of the active agents has been already served; furthermore, this event is 
independent of whether e is active itself. The expected revenue that our COPM gets from agent e is therefore 
at least c • R e (x e ), which completes the proof. 

Extension to other objectives 

Finally, we notice that, as highlighted by Yan l(24l . the used relaxation can easily be extended to a much 
larger class of objective functions that are decomposable with respect to the agents. More precisely, these 
are objectives of the form E[]C eG/v 1 z e >p e ■ g e (Z e ,p e )], where for e £ N, g e is a function of the (random) 
valuation Z e of e and the price p e offered to e. In particular, the maximization of revenue which we dis¬ 
cussed above corresponds to g e (Z e ,p e ) = p e . Similarly, one can deal with welfare maximization or surplus 
maximization by defining g e (Z e ,p e ) = Z, and g e (Z e ,p e ) = Z, — p e , respectively. The above reasoning 
why our COPM is at most a factor of c worse than the optimal truthful mechanism extends to such objectives 
without modifications. 

4.3 Stochastic probing 

We begin with the proof of Theorem 11.171 Consider the following relaxation. We use w in the relaxation 
to denote the natural extension of w to vectors (formally, w(x) = YlecN w ( e ) ' A)- Additionally, the 
relaxation uses the expression p o x to denote the element-wise multiplication of the probabilities vector p 
and the variables vector x. Clearly this relaxation can be solved efficiently when there is a separation oracle 
for the polytopes I\ n and P ou t- 


(Rl) max w(p o x) 

pox £ P in 
■E € Pout 
x £ [ 0 , 1 ]* 

The following lemma proves an important property of (.Rl). The proof of this lemma is based on the 
observation that one feasible solution for (Rl) is the vector x £ [0,1] A in which x e is equal to the marginal 
probability that the optimal algorithm probes element e. 

Lemma 4.1 (Claim 3.1 of | 17 )). The optimal value of (Rl) upper bounds the the expected performance of 
the optimal algorithm for the weighted stochastic probing problem. 

Let x* be an optimal solution for (Rl). By Lemma I47TT to prove Theorem 1 1.171 we only need to show 
an algorithm for the weighted stochastic probing problem which finds a solution of expected weight at least 
b{ci n ■ c ou t) ■ w{pox*). Our algorithm for the weighted stochastic probing problem is given as Algorithm!]] 
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Algorithm 1: Probing Algorithm 

1 Let A out be a random set distributed like R(bx*). 

2 Let F out f Tout be an instantiation of the random family F Wout fix*- 

3 Let Fi n C Fi n be an instantiation of the random family ^ r 7rin iPO (6a;*)- 

4 Let Q, S £- 0. 

5 for every element e £ N in the order chosen by the adversary do 

6 if e € A out , S U {e} € Fi n and Q U {e} £ F out then 

7 Add e to Q and probe e. 

8 if e is active then Add e to S. 

9 return S. 


The next observation shows that Algorithm Q] is a legal algorithm for the weighted stochastic probing 
problem. 

Observation 4.2. The following always hold when A Igorithm [7] terminates: 

• The set Q of probed elements is in F out C F ou t- 

• The set S of selected elements is in Fi n C F lri . 

• The set S contains exactly the active elements of Q. 

In the rest of the section we use notation and results introduced in Section [3] Let 7f m and Tt out denote the 
characteristic CRSs of the greedy OCRSs 7 Ti n and tt ou / , respectively. We would like to use 7f in and ir out to 
lower bound the value of a subset of S, and through that subset also the value of S. To achieve that objective 
we first need to describe the said subset of S as an expression of 7fj n and 7f out . 

Let Ai n be the set of elements that belong to A out and are also active. One can observe that A in is 
distributed like R(p o x). Additionally, let us couple the randomness of Algorithm Q] and the CRSs 7f m and 
Ttout as follows: we use the same instantiations for the random families F niniPQ (bx*) and in both 

Algorithm [Hand the definitions of 7fj n and 7f out , respectively. Notice that this coupling implies: 


and 


7Tm(^4m) — £ Ai n | I U {e} £ Fin V/ C Ai n , I £ Fin\ 


^out^Aout) — {s £ A out | I U {e} £ F Ju t. V/ C A ou t , I £ F Ju t} 


Observation 4.3. TT in (A in ) n n out (A out ) C S. 


Proof Consider an element e £ 7fj n (Aj n ) n 7f 0)j/ (A 0)J ./J. Since e € TT in (A m ) C A in , e must be both active 
and in A out . Let S e and Q e denote the sets S and Q immediately before e is processed by Algorithm [H 
Clearly S e C A rn and S e £ F in . Together with the fact that e £ 7f,; n (A, n ), these observations imply that 
S e U {e} £ F tn ■ An analogous arguments shows also that Q e U {e} £ F ou t. Hence, we proved that e is 
an active element obeying all the conditions on Line [6] when processed by Algorithm [Q and therefore, e is 
added to S by the algorithm. □ 


We defined A out as a random set distributed like Ilibx*) and A vn as the intersection of A m ,i and the 
set of active elements. However, for the purpose of analyzing the value of the set ff m ( A vn ) D Tt 0U t(A 0 ut) 
we can assume any construction procedure that results in the same joint distribution of Ai n and A out . The 
following is a convenient construction that we are going to use from this point on: the set Ai n is a random 
set distributed like R(p o ( bx *)). The set A out is calculated by starting with A rn and adding to it every 
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element e ^ A rn with probability bx*(l — p e )/(1 — bp e x*), independently. Notice that this construction 
indeed produces the same joint distribution of the sets An and A out as the original construction. For ease of 
notation, let us denote by z a vector in [0,1 ]defined by: z e = bx*(l — p e )/( 1 — bp e x* ) for every e € N. 
Using this notation we get that A out has the same distribution as A rn U R(z). 

The new construction of A out implies that A out is a random function of A in , and so is the expression 
% in{A in ) n TT ou t(A out ). Thus, we can define a new CRS i r for P in by the equality it (An) = An(An) n 
Kout(Aout)- Notice that n is a true CRS for P in in the sense that it always outputs a set in T in since An (An) 
is guaranteed to be in Ti n . Let us now study the properties of it. 

Lemma 4.4. The CRS it is monotone. 

Proof. We need to show that every element e € N and two sets e G Tj C T 2 C N obey the inequality: 

Pr[e € A An) | A in = Tf = Pr[e <E Kin (An) FI it out (A out ) \ A in = Tf 
> Pr[e G it in (A in ) n it out (A out ) | A in = T 2 \ = Pr[e G it (An) I An = T 2 \ . 

This is true since: 


Pr[e G iti n (Ain) n it ou t(A out ) \ A in = Ti] = Pr[e G An(?i) n it ou t(Ti U R(z))} 

= Pr[e G An (A)] • Pr[e G A«t(?t U R(z))} > Pr[e G 7Tj n (T 2 )] • Pr[e G it out (T 2 U .R(z))] 

= Pr[e G * in (T 2 ) Cl it out (T 2 U #0))] = Pr[e G it in (An) n it 0 ut(A 0 ut) \ An = T 2 \ , 

where the inequality follows since both 7f, n and it out arc monotone by Lemma l3Al □ 

The following lemma shows that it obeys a weak variant of balanceness. 

Definition 4.5. A CRS irfor a polytope P is (x, c)-balanced for a vector x and c G [0,1] if Pi [e G tt(R(x)) \ 
e G i?(x)] > cfor every element e G N having x e > 0. 

Lemma 4.6. The CRS it is (p o (bx*),Ci n ■ c ou t)-balanced. 

Proof. Since A{ n is distributed like R(p o (bx*)), we need to show that Pr[e G 7fm(An) H H ou t(A ou t) \ e G 
Ai n ] > Cf • c 2 holds for every element e G N having bp f x* > 0. 

Since 7fj n and it out are monotone by Lemma l3~4l we get that both Pr[e G T rn (T)] and Pr[e G it ou t(T U 
R(z))] are decreasing functions of T as long as e is in T. Thus, by the FKG inequality: 

Pr[e G Ttin(Ain) I") T^out(A 0 ut) \ 6 F A ?n ] — Pi [e G Ttin(Ai n b) FI Tt out(Ai n U R(%)) \ & G Aj n ] 

> Pr[e G 7f*n(An) I e G A in ] ■ Pr[e G 7r 0 ut(A in U R(z)) \ e G An] 

— Pr[e G Ttin(Ain) \ C G Ai n ] ' Pi [e G 'Xout(Aout) | c F A on j] , 

where the last equality uses the fact that the membership of every element in the sets An and R(z) is 
independent from the membership of other elements in these sets. 

The set A rn is distributed like R(p o (bx*)) and the vector p o (bx*) is inside the polytope bPi n - Thus, 

since 7f,; n is (b. c m )-balanced by Lemma 13.41 we get: Pr[e G An (An) I e F An] A c in . Similarly, the 

set A out is distributed like R(bx*) and the vector bx* is inside the polytope bP out . Thus, since it ou t is 
(b,Cout)- balanced by Lemma lT4l we get: Pr[e G Hi n (A out ) \ e G A out ] > c ou t- The lemma now follows 
by combining the above inequalities. □ 

In the following corollary we use w to denote its natural extension to sets, i. e ., w(T) = ffe&T w ( e )- 

Corollary 4.7. E[m(S 1 )] > b(c in ■ c out ) ■ w(p o x*). 
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Proof. By Lemma 14.61 linearity of the expectation and the observation that A. in is distributed like R(p o 

(<bx *)), we get: 

E[w(Tr(A in ))] = E w ( e ) • Pr I e e F(R(p o ( bx *)))] 

e&N 

= "22 w ( e ) ' Pr ( e € R(p o (&x*))] • Pr[e 6 Tt(R(p o (bx *))) | e € R(p o (6x*))] 

e&N 

> E W ( e '> ‘ ( Pe ° ( ftx e)) ' ( c in • C ou t) = &(Cin ' C out ) • U>(p O X*) . 
e£N 


Since all the weights are non-negative and ?r(A m ) = 7r m (A m ) n n ou t(A out ) C S by Observation 14.31 the 
last inequality implies E[tu(5)] > E[m(7f (A in ))] > b(ci n ■ c out ) ■ w(p o x*). □ 

Following the above discussion. Theorem 11.171 is implied by the last corollary. We can now prove 
Theorem [T7T8] as a direct consequence of Theorem 1 1.171 

Proof of Theorem U. 1 8\ Consider a down-closed set P C 2 V containing every set T C A T if and only if all 
the elements of T can be queried while respecting the deadlines. Formally, 


T = |t C 2 n 


Vi< d <| 7 V| |{e G T | d e < d}\ < d| . 


By definition (N, T) is a laminar matroid, thus, by Theorem 1 1. 81 there exists a (b, 1 — 6)-selectable greedy 
OCRS for its matroid polytope Pj. Together with the existence of n nv t we get, by Theorem 1 1.91 a (b. (1 — 
6)c ou t)-selectable greedy OCRS for the polytope P' nut = P out FI Pj. Notice that this polytope is a relaxation 
of the down-closed family T' out = P out 0 T. Moreover, P' out has a separation oracle whenever P out has 
such an oracle. 

For convenience, let us use (Pi, Pf) -probing as a shorthand for the weighted stochastic probing problem 
with P\ and Pi as the inner and outer constraints, respectively. Consider the best algorithm for (Pi n ,Pout)- 
probing with deadlines. Since this algorithm probes with respect to the deadlines, the set of elements it 
probes must be in P. Hence, the same algorithm is also an algorithm for (Pi n , P' out ) -probing. Thus, by 
Theorem ll.l7l we have an algorithm A LG for (Pin, P' out )- probing whose approximation ratio is l)(l~b)-c rn ■ 
c ou t compared to the best algorithm for (Pin, Pout)- probing with deadlines. Moreover, the approximation 
ratio of ALG holds regardless of the order in which ALG can probe elements. 

The algorithm we suggest for (Pi n ,P ou t)- probing with deadlines is ALG when we allow it to probe 
elements in increasing deadlines order. We have already proved that ALG has the approximation ratio 
guaranteed by the theorem, so we only need to explain why does it respect the deadlines. Assume towards 
a contradiction that ALG probes element e after time d e . This means that ALG probes a set T of at least 
d e elements before it probes e. However, since ALG can probe elements only in increasing deadlines order, 
all the elements of T U {e} have a deadline of at most d e . The last observation implies that T U {e} 0 P, 
which contradicts the fact that the set of elements probed by ALG is always in P' out C p. □ 

The rest of this section is devoted to proving Theorem 11.191 Let /: 2^ —>• M>o be the non-negative 
monotone submodular objective function of the problem, ;. e ., the value of an output S of the probing algo¬ 
rithm is f(S). We need to introduce an extension of / to [0, 1 ] /Y studied by (6|. 


f + (x) = max < 

E “T • f(T) 

'y ^ olt 5; ot-T P 0 and V e gjv 

E a T < x e\ 


k TCN 

TCN 

eeTQN ) 
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Intuitively, f + is equal to the largest possible expected value of / over a distribution of sets in which 
every element e appears with a marginal probability at most x e . Using this extension, we can now introduce 
a variant of the relaxation (Rl) that works for monotone submodular objectives. 

(R2) max f + {pox) 
pox £ Pin 
X £ Pout 

x £ [0,1]^ 

Let us explain why we use the extension f + in (R2) instead of the simpler multilinear extension. An 
algorithm for the submodular stochastic probing may choose the next element to probe based on the set 
of elements previously probed and the results of these probes. Thus, the membership of elements in the 
solution produced by the algorithm is not independent, and this is captured by f + . Using this intuition, the 
work of (}} implies the following counterpart of Lemma 14. II 

Lemma 4.8. The optimal value of {R2 ) upper bounds the the expected performance of the optimal algorithm 
for the submodular stochastic probing problem. 

Additionally, |(T]l also shows that a variant of the continuous greedy algorithm of 0 can be used to find a 
point x obeying all the constraints of (R2) and also the inequality F(p o x) > (1 — e -1 ) ■ f + (p o x*), where 
F is the multilinear' extension of / and x* is the optimal solution for ( R2 ). The same argument can also be 
used to show that by stopping the continuous greedy algorithm at time b, instead of letting it reach time 1, 
one gets a point x £ [0,1] N obeying pox £ bPi n , x £ bP out and F(pox) > (1 — e~ b — o(l)) • / + (pox*)o 
The algorithm we use to prove Theorem ll.l9l is Algorithm [T] modified by replacing the vector bx* with 
x. Additionally, we use the same definition of the CRS tt given above, and observe that Lemmata 14.41 and 
14.61 still apply to this CRS (with x replacing bx* in the appropriate places). To analyze the output of this 
CRS we observe that the proof of ifTOl for Lemma [331 in fact proves the following stronger version of the 
lemma. Note that this version strictly generalizes Lemma 1331 since being (6, c)-balanced is equivalent to 
being (x, c) -balanced for every vector x £ bP. 

Lemma 4.9. For every given non-negative submodular function f: 2 N —> R>o, there exists a function 
rjf\ 2 N ^ 2 n that always returns a subset of its argument (i. e ., rjf(S) C S for every S C N) having the 
following property. For every input vector x £ [0,1] ;V and monotone (x. c)-balanced CRS tt: 

m(Vf(n(R(x))))] > c • F(x) , 

where F(x) is the multilinear extension of f. 

We are now ready to prove the next lemma, which together with Lemma l4~8l proves Theorem II. 191 

Lemma 4.10. E[/(S)] > (c in ■ c ou f) • F(p o x), where S is the output set of the modified Algorithm\T\ 

Proof. Let S' be the set r]f(Tr(Ai n )) C tt (Aj n ) = Tti n (A in ) r\TT out (A out ) C S. By combining Lemmata l4.4l 
I4.6l and l4~9l and using the observation that A in is distributed like Rip o x), we get: 

EI/CS 1 ')] > (■ Ci n ■ C^t) ■ F(P ° X) . 

Using the monotonicity of / we now get: E[/(S)] > E[/(S")] > (a n ■ c ou t ) • F(p o x). □ 

12 The idea of running the continuous greedy for less time instead of scaling its output was first introduced by El- 
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A Definitions of Matroidal Concepts 

Recall that a matroid M = ( N , J 7 ) is a tuple consisting of a finite ground set N, and a nonempty family 
T C 2 n of subsets of the ground set, called independent sets, which satisfy: 

(i) / CJeT^/eT, and 

(ii) /, J € T, \I\ > | J| =A 3e <G I \ J s.t. J U {e} <G T. 

The rank of a set S C 2 V is the size of a maximum cardinality independent subset of S. The rank 
function of the matroid M is a function rank: 2 N -* Z>o (where Z>o is the set of all non-negative integers) 
assigning each set its rank. More formally, 

rank(S') = max{|/| | / S 7, / C 5} . 

Observe that the rank of an independent set is equal to its size. The rank of the matroid M itself is defined 
as rank(iV). Notice that rank(S) < rank(iV) for every subset S C N. A set S C N is called a base of M 
if it is independent and has maximum rank, i.e., 15*1 = rank(S') = rank(iV). 

We say that an element e G N is spanned by a set S C N if adding e to S does not increase the rank 
of S. On the other hand, the span of a subset S C N is the set of elements that are spanned by it. More 
formally, the span of a set S is span(5) = {e £ N | rank(5 + e) = rank(5)}. 

Given a subset N' C N, the restriction of M to N', denoted by M\n', is the matroid obtained from 
M by keeping only the elements of N'. Formally, M\^r is the matroid (iV 7 , T 0 2 ;V ). On the other hand, 
contracting N' in M results in another matroid, denoted by M/N', over the ground set N \ N'. A set is 
independent in M/N' if and only if adding a base of N' to it results in an independent set of M. It turns 
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out that this definition is independent of the base that is chosen for N'. Formally, M/N' is the matroid 
{N\N',F'), where: 

r = {S c N\N' \ rank (S \J N') = \S\ + rank(JV')} . 
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